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Interactive Threshold Tuning 

Field 

[0001] This invention relates to the field of integrated circuit fabrication. More 
particularly, this invention relates to optimizing the operational parameters of inspection 
5 equipment used during integrated circuit fabrication. 



Page 2 of 21 



Express Mai! Label Number: EV 327 364 1 18 US 

Background 

[0002] Integrated circuit fabrication relies heavily on frequent and consistent inspection 
of the structures formed at various stages during the fabrication process. Some of the 
inspections can be electronic or chemical in nature, but a great many of the inspections 
5 that are performed are optical in nature. In other words, the substrates or semiconductor 
wafers on which the integrated circuits are formed are inspected by collecting 
electromagnetic radiation such as light received from the substrate, whether that light be 
reflected from or transmitted through the substrate, and inspecting the properties of the 
collected light. 

10 [0003] Most optical inspections in this day are accomplished by digitizing the collected 
light and then analyzing the digitized images with sophisticated computerized analytical 
routines, which compare the images to one or more of a variety of baseline or 
standardized references, and then detect differences between the captured images and the 
references. The routine then further attempts to identify the nature of any differences so 

15 detected. This general process is typically very helpful to process engineers and others 
who are responsible for monitoring and improving both the integrated circuits so formed 
and the processes by which they are fabricated. 

[0004] However, there are several inherent difficulties in such an optical inspection 
process. One general class of issues deals with the issue of how closely to inspect the 

20 substrate. For example, optics having greater magnification will detect smaller and 
smaller flaws. Light of smaller wavelength will also detect smaller flaws in the substrate. 
A sensor having a higher resolution, such as a charge couple device having a greater 
number of and smaller-sized pixels, can also detect smaller flaws. Further, software 
routines can be set using a variety of different parameters to, at one end of the spectrum, 

25 flag every difference between a substrate image and a reference as a defect, and at the 
other end of the spectrum, ignore all but the very largest of differences. Thus, some 
degree of tuning or optimization of the inspection equipment is typically performed. 

[0005] Typically, users optimize inspection recipes in a very laborious trial and error 
procedure. Starting with any desired recipe, such as a set of threshold parameters that 
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control the sensitivity of an inspection scan, the user runs the inspection with the recipe 
and then reviews the defects caught by the inspection. If the inspection doesn't catch 
enough defects of interest, the user lowers or otherwise adjusts one or more threshold 
parameter. On the other hand, if the recipe caught too many anomalies which were not of 
5 interest, the user increases or otherwise adjusts one or more threshold. The user then 
rescans the substrate with the modified recipe and reviews the inspection result again. 
The user repeats these three steps of tweaking parameters, rescanning the substrate, and 
reviewing the result, until he arrives at an acceptable set of threshold values. 

[0006] The inefficiency of this old method becomes much worse for more advanced 
10 defect detection algorithms, such as the segmented auto threshold algorithm of the bright 
field machines made by KLA-Tencor Technologies Corporation of Santa Clara, 
California, that require many threshold parameters, and the number of iterations is 
multiplied by the number of threshold parameters. 

[0007] The first problem with the old methods is the long setup time. Both scanning the 
15 substrate and reviewing the results can take a long time and lots of effort. The second 
problem is that the resulting recipes are usually far from optimal. One reason for this is 
that when using this manual optimization method, the machine provides very little if any 
information about the defects, and the user doesn't know how or how much more the 
recipe can be improved. As a result, the user essentially has to count on his intuition or 
20 experience in adjusting the parameters, and usually settles on a set of values that are far 
from optimal. In addition, because the manual method is so time consuming, many users 
get to a certain level of optimization, and then just quit. 

[0008] What is needed, therefore, is a system by which parameter threshold optimization 
can be more easily accomplished and thereby produce better results. 
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Summary 

[0009] The above and other needs are met by a method of tuning an inspection system. 
Characteristics of an inspection piece are sensed using the inspection system, and the 
sensed characteristics are analyzed to identify anomalies having location information and 
5 level information. The level information of the anomalies is analyzed with an initial set 
of thresholds of inspection system parameters, and an initial portion of the anomalies are 
flagged as defects based on the analysis of the level information. A summary of the 
flagged anomalies is displayed, and an operating curve of potential flagged defects versus 
threshold for at least one of the inspection system parameters is also displayed. Then at 

10 least one of the inspection system parameters is selectively changed to form a modified 
set of thresholds of the inspection system parameters, and the level information of the 
anomalies is analyzed with the modified set of thresholds of the inspection system 
parameters. An updated portion of the anomalies is flagged as defects based on the 
immediately preceding analysis of the level information, and a summary of the flagged 

15 anomalies is displayed. The steps of selectively changing the thresholds and reflagging 
the defects are repeated as desired, and the modified set of thresholds of the inspection 
system parameters are stored for use in an inspection system recipe. 

[0010] In this manner, the system enables users of inspection systems, such as bright 
field inspection systems, to efficiently and effectively optimize inspection recipes. The 

20 system collects special runtime data, such as the level information, produced during a 
substrate scan, and then provides an informative and interactive graphical user interface 
environment that enables the user to tune the threshold parameters of the recipe and get 
real time feedback on the effect of the tuned thresholds, without rescanning the substrate. 
Thus, the present system provides immediate feedback on the effects of changing the 

25 system parameter thresholds, and enables the user to quickly tune the inspection system 
to increase and preferably maximize the flagging of the defects of interest, while reducing 
and preferably eliminating the flagging of anomalies in which there is no interest. 

[0011] In various preferred embodiments, the inspection system is an optical inspection 
system. The inspection piece is preferably a semiconducting wafer. Preferably, the 
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characteristics of the inspection piece are surface defects. In a preferred embodiment, a 
spatial representation of the flagged anomalies on the inspection piece is selectively 
displayed. 

[0012] According to another aspect of the invention there is described an inspection 
5 system having sensors adapted to sense characteristics of an inspection piece. A 
processor analyzes the sensed characteristics to identify anomalies having location 
information and level information, analyzes the level information of the anomalies with 
an initial set of thresholds of inspection system parameters, and flags as defects an initial 
portion of the anomalies based on the immediately preceding analysis of the level 
10 information. A display displays a summary of the flagged anomalies and an operating 
curve of potential flagged defects versus threshold for at least one of the inspection 
system parameters. An input selectively changes the at least one of the inspection system 
parameters to form a modified set of thresholds of the inspection system parameters. The 
processor further analyzes the level information of the anomalies with the modified set of 
15 thresholds of the inspection system parameters, and flags as defects an updated portion of 
the anomalies based on the immediately preceding analysis of the level information. The 
display further displays an updated summary of the flagged anomalies. A memory stores 
the modified set of thresholds of the inspection system parameters for use in an 
inspection system recipe. 
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Brief Description of the Drawings 

[0013] Further advantages of the invention are apparent by reference to the detailed 
description when considered in conjunction with the figures, which are not to scale so as 
to more clearly show the details, wherein like reference numbers indicate like elements 
5 throughout the several views, and wherein: 

[0014] Fig. 1 is a flowchart of a method for collection of threshold data during inspection 
of a substrate, according to a preferred embodiment of the invention. 

[0015] Fig. 2 is a flow chart of a method for interactive threshold tuning, according to a 
preferred embodiment of the invention. 

10 [0016] Fig. 3 is a chart of a defect detection function with respect to a first parameter and 
the effect of changing the first parameter. 

[0017] Fig. 4 is a chart of the defect detection function with respect to a second 
parameter and the effect of changing the first parameter. 

[0018] Fig. 5 is a chart of the defect detection function with respect to an nth parameter 
15 and the effect of changing the first parameter. 

[0019] Fig. 6 is a chart of the defect detection function with respect to the first parameter, 
and the effect of changing the first parameter on defect type. 

[0020] Fig. 7 is a functional block diagram of an inspection system according to a 
preferred embodiment of the invention. 
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Detailed Description 

[0021] With reference now to Fig. 1, there is depicted a method 10 of collecting 
threshold data during an inspection scan, such as the optical inspection of a substrate. 
However, it is appreciated that the methods and devices as described herein can also be 
5 applied to inspection types other than optical, and inspection objects other than 
substrates. 

[0022] The method 10 preferably commences with a scan of the substrate as given in 
block 12. The substrate scanning step is the step in which information in regard to the 
inspection piece, in this case an integrated circuit substrate, is gathered, which in this case 
10 means capturing the optical images, such as with a charge coupled device filtered to 
accept a given range of wavelengths of light, such as visible light. Step 14 of the method 
10 is an entry point for a portion of the method that is repeated for each image frame of 
the substrate that is captured, including step 16, where the detection algorithms are 
employed to flag any detected anomalies as defects. 

15 [0023] Step 18 of the method 10 is an entry point for a smaller portion of the method 10 
that is repeated for each defect that is detected in the frame currently being analyzed, 
including step 20, where at least one threshold margin is computed for the defect. This 
information, both the designation of a flagged defect as determined in step 16, and the 
computed threshold margin or level information as determined in step 20, is saved as 

20 frame data in step 22 of the method 10. The routine then cycles through to determine the 
threshold data for each defect detected, and then cycles through each frame to determine 
all the defects in all of the frames. Thus, the method 10 collects and stores not only data 
in regard to identified defects, but also data in regard to a relative level of a detected 
anomaly, and the level of the anomaly in regard to the threshold of the parameter by 

25 which it was, or was not, flagged as a defect. 

[0024] With reference now to Fig. 2, there are depicted the steps of the method 30 for 
interactive threshold tuning, or optimization, of the defect detection routine that is 
employed such as in step 16 of the method 10. The purpose of the method 30 is to 
optimize the settings of the various parameters used in the defect detection routine 16, so 
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that most preferably real defects which affect yield are detected and flagged as defects, 
and other anomalies which do not affect yield are either not detected or are not flagged as 
defects. 

[0025] The method 30 commences by loading the frame data, including the defect data 
5 and the threshold data collected and stored as a part of the method 10, as given in block 
32. In step 34, the inspection recipe, or in other words the set of parameters controlling 
the defect detection function used such as in step 16 of the method 10, is also loaded. A 
simulation of the defect detection process is accomplished as given in block 36, whereby 
the threshold values specified in the inspection recipe are applied to the frame data, and 
10 the results, such as a summary, of the simulated detection are displayed as given in block 
38. 

[0026] In addition to displaying the results of the detection operation, operating curves 
for the various input parameters of the detection routine or recipe are also computed and 
displayed, as given in block 40. The operating curves depict information such as that 

15 generally represented in Figs. 3-6. Fig. 3 depicts a chart of a function, such as the count 
of defects detected in step 16 of the method 10, versus the value of an input parameter or 
threshold PI. The chart depicts a curve showing the relationship between the defects 
detected by the function at various values of PI, such as pl and pl\ Fig. 4 depicts 
similar information for an input P2, and Fig. 5 depicts similar information for an input 

20 Pn(i). Fig. 6 depicts the output of the defect detection function for various values of PI, 
broken down into defect types, such as killer defects, real defects but not killers, and 
nuisance defects which are detected anomalies but not defects at all. 

[0027] Once the information as described above has been depicted, such as in the 
graphical interface of a computing device connected to inspection equipment, either 
25 locally or remotely, the system prompts the user to take one of the allowable actions, as 
given in block 42 of the method 30 depicted in Fig. 2. As depicted in Fig. 2, the 
allowable actions include the ability to show the defects as given in block 44, select a 
different parameter for investigation or optimization as given in block 46, change a 
parameter value as given in block 48, or complete the optimization process as given in 
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block 50. After any one of these various options is selected and accomplished, except of 
course for finishing the routine as given in block 50, the routine returns to block 42 to 
await further user instruction. Each of these options is described in more detail below. 

[0028] When the user selects the option to show the defects, as given in block 44, the 
5 system updates a display of defects on a substrate map as given in block 52, such as a 
spatial display with the representation of the substrate, and markings indicating defects. 
Additional information may also be presented, such as indicating defect type such as by 
color or differing defect indication indicia on the substrate map. This provides a visual 
feedback to the user for the current results of the optimization procedure 30. 

10 [0029] Different parameters for optimization are selected in block 46 which, when 
selected, computes and displays an operating curve as given in block 54, such as depicted 
in Figs. 3-6. Different values for the various parameters can be changed as given in block 
48. When a parameter threshold is changed, the system performs another simulation of 
the defect detection routine as given in block 56, updates the display of the summary of 

15 the defect detection routine as given in block 60, and awaits further input from the user. 
When the optimization routine is exited as given in block 50, the current threshold values 
for the various parameters are saved as a part of the tuned recipe as given in block 58. 

[0030] Thus, a system incorporating the methods as described herein greatly enhances 
the level to which an inspection system can be optimized, because it does not require that 
20 a new scan of the substrate be performed after each parameter threshold adjustment. One 
reason for this is that the frame data includes not only defect information, such as 
location information, but also threshold information in regard to the level of the detected 
anomaly in relation to the parameter threshold. 

[0031] With reference now to Fig. 7 there is depicted an inspection system 100 having 
25 sensors 102 adapted to sense characteristics of an inspection piece. A processor 104 
analyzes the sensed characteristics to identify anomalies having location information and 
level information, analyzes the level information of the anomalies with an initial set of 
thresholds of inspection system parameters, and flags as defects an initial portion of the 
anomalies based on the immediately preceding analysis of the level information. A 
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display 106 displays a summary of the flagged anomalies and an operating curve of 
potential flagged defects versus threshold for at least one of the inspection system 
parameters. An input 108 selectively changes the at least one of the inspection system 
parameters to form a modified set of thresholds of the inspection system parameters. The 

5 processor 104 further analyzes the level information of the anomalies with the modified 
set of thresholds of the inspection system parameters, and flags as defects an updated 
portion of the anomalies based on the immediately preceding analysis of the level 
information. The display 106 further displays an updated summary of the flagged 
anomalies. A memory 110 stores the modified set of thresholds of the inspection system 

10 parameters for use in an inspection system recipe. 

[0032] More detail is now provided in regard to certain aspects of the invention. Various 
embodiments of the present invention comprehend a general software tool, an apparatus, 
and a method for tuning the parameters of a defect detection algorithm such as one 
employed to detect defects on a substrate such as a semiconductor wafer that consists of a 
15 planar surface with a plurality of dice on it. A defect detection algorithm typically 
examines one or more captured images of the dice, compares similar images at each pixel 
location and uses a discriminant function to determine differences between the images. If 
a difference is detected, the function further determines whether or not that difference 
should be flagged as a defect on the substrate. 

20 [0033] The discriminant function preferably uses a set of parameters that controls the 
sensitivity of the algorithm. These parameters usually have to be individually and 
manually optimized for a given substrate by layer type, such as the material and types of 
geometry that are digitized by the scanning system and fed to the detection algorithm. 
The parameters are preferably optimized to maximize the number of defects of interest, 

25 or in other words defects that affect product yield, that are detected and flagged as such, 
while minimizing the number of nuisance events detected. A nuisance event is a defective 
pixel or other imaging anomaly that is flagged as a defect by the algorithm but in fact 
does not affect yield. Measurement noise, variations in film thickness from one die to the 
next, and metal grain are examples of events that might be flagged as defects but do not 

30 affect semiconductor product yield. 
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[0034] The generalized parameter tuner preferably displays a set of one or more 
operating curves showing the number and type of defects detected as a function of each 
algorithm parameter. Of course, this information can also be presented as bar charts, 
tables of numbers, pie charts, or other suitable formats. However, the central concept is 

5 that of allowing the user to select one or more operating points in the parameter space and 
immediately view the algorithm performance without having to rescan the substrate on 
the inspection system. The algorithm performance view can be, for example, in the form 
of defect counts by type, or a two dimensional substrate map showing where the defects 
lie on the substrate surface or as a stacked die map showing where the defects lie relative 

10 to each die. 

[0035] An important aspect of the generalized parameter tuner is the ability to update the 
display of curves, charts, or maps as the user modifies the operating points in the 
parameter space. If a given parameter is a function of the other parameters, then changing 
that parameter value causes all the other operating curves to change appropriately. 

15 [0036] The defect detection algorithm can be defined as a generalized function F() with n 
parameters, PI, P2,.. Pn, where F(pl,p2,..pn) denotes the number of defects detected by 
the algorithm for parameter values of Pl=pl, P2=p2,.. Pn=pn. The function F can take on 
several forms. For example, in some cases, F can be written as the sum of r separable 
functions F(pl,p2„pAz) = Fl(pl, p2,..) + F2(pl,p2,..) +... Fr(pl,p2..). This may be the 

20 case, for example if each die is divided into r regions and F/() denotes the defects found 
for the given parameter setting in the i th region. 

[0037] In some cases, the function F may be separable in parameter space, meaning that 
each parameter determines a subset of the defect population as given by F(pl,p2..pn) = 
Fl(pl) + F2(p2)...+ Fn(prc). In other cases, some parameters are coupled and others are 
25 not, and F() is the sum of s separable terms, such as in for example, F(pl,p2,..pn) = 
Fl(pl,p2) + F2(p3,p4)... Fs(p£,pn). In this example, Fl is a function of PI and P2 but 
not of P3, P4, etc. In general, if the function F can be broken down into m terms, Fl(), 
F2(),.. Fm(), where each F/() is a function of n(i) parameters, PI, P2,... Vn(i), the user can 
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manually tune the n(i) parameters using a set of n(i) operating curves as depicted in Figs. 
3-5. 

[0038] Each solid curve shows the variation in the defect count, F/() as a function of a 
particular parameter keeping all the other parameter values at their current operating 

5 values. Note that each solid curve shows the current operating point for the corresponding 
parameter, i.e. the operating value of PI = pi, P2 = p2,.... ?n(i) = pn(i). If the user 
modifies the operating value of parameter PI from pi to, say pV as shown in Fig. 3, then 
all the other operating curves for F/() vs. P2, FiQ vs. P3, etc. are changed as shown by 
the dotted lines. This is because each operating curve is a function showing the variation 

10 of defect count versus that parameter value, given specific values of all the other 
parameters. The initial operating curves (solid curves above) were the functions F/(Pl,p2, 
p3,..pn(i)), F/(pl,P2,p3,..pn(i)), F/(pl,p2,P3,p4,..pn(i)), .... F/(pl,p2,..Pn(i)). 

[0039] If the user changes the operating value of PI from pi to pl\ as shown in Fig. 3, 
the Fi(Pl,p2,..pfffiV) curve remains unchanged, since the values of parameters 
15 P2,P3,..Pn(^ are still at p2, p3 ,..pn(i) respectively. However, the other curves get 
recomputed as shown in dotted lines to represent the functions, F/(pl',P2,p3,p4..p/2(^), 
F/(pl\p2,P3,p4,..pn(i)), ... F/(pl\p2,p3...Pn6>) because PI has changed in value from 
Pl=pl toPl=pl\ 

[0040] If the defects are classified in some way, either manually by the user or via an 
20 automatic defect classification algorithm, then instead of showing a single operating 
curve of total defect count versus a given parameter value, one can split the defect count 
by defect type (e.g. killer, real, don't care, nuisance, etc.) or defect class (particles, 
pattern, color variation grain, etc.) and show a set of operating curves, one per type/class, 
for each parameter value as shown in Fig. 6, which depicts Yi(J?\ 9 ..pn(i)) showing defect 
25 counts per defect type as a function of PI. 

[0041] Each time any operating point is changed by the user, the display program updates 
the substrate map or stacked die map to display defects that are detected. If the defects 
are classified by type/class, the substrate map can show the type of each defect using 
color or other suitable icons. By modifying each parameter in turn, the user is able to 
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instantly see the effect on the detection results and make a tradeoff between sensitivity 
and nuisance rate. 

[0042] The system preferably consists of three major parts. The first part is to add a 
special data collection function to a substrate inspection scan. Thus, in addition to 

5 detecting defects during the scan of the substrate, the system also collects run time data 
that determines how the threshold values are set for each pixel, and how much margin 
with respect to the threshold values a defect is categorized as flagged or unflagged. 
Because the current system processes and detects defects one image frame at a time, such 
data is referred to as frame data. The second part is an algorithm that simulates the 

10 detection results of a given recipe in real time using the frame data. The third part is a 
graphical user interface, in which the system displays a summary of the simulated results 
of a recipe, the operating curve of each threshold parameter - or in other words the 
number of detected defects as a function of the threshold value - and allows the user to 
manipulate the threshold values and see the modified simulation results. 

15 [0043] To use the system, the user either has an inspection result that already includes the 
frame data, or the user starts with a base recipe. In the latter case, the system preferably 
first runs the special substrate scan to collect the frame data. Then the system preferably 
guides the user to classify some of the defects detected in the special substrate scan. After 
the classification, the system preferably automatically generates an initial recipe, and 

20 takes the user to the recipe tuning phase. In the recipe tuning phase, the system preferably 
brings up a graphical user interface. The graphical user interface preferably consists of 1) 
a window showing the current threshold values and the summary of the detection results 
of the recipe, and 2) two windows showing the operating curves of the selected threshold 
parameters. 

25 [0044] To obtain the detection summary, the system preferably performs a defect 
detection simulation by applying the recipe on the frame data. The system then preferably 
summarizes and displays the detected defects by types. Next, the system preferably 
computes and displays the operating curve for each threshold parameter. To compute the 
operating curve, the system preferably extracts the frame data of the particular threshold 
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parameter, and transforms the frame data to the operating curve. On the operating curve, 
the user can see the number of detected defects of each type as a function of threshold 
value, and can graphically set the parameter at a desired value. When the user changes 
the value of a particular parameter, the system preferably reruns the simulation and 
5 displays a summary of the new detection results. The user can instruct the system to show 
all the detected (flagged) defects or the undetected (unflagged) defects. 

[0045] Compared to traditional methods, this invention, by means of showing the 
operating curves, allows the user to visualize the trade-off between flagging real defects 
and flagging nuisances when the threshold values are tuned. Also, this invention allows 
10 the user to get real-time feedback after tuning the threshold parameters without 
rescanning the substrate. 

[0046] The current implementation is designed for the segmented auto threshold 
algorithm, and the data collected as described above is specific for the segmented auto 
threshold algorithm. Other possible constructions of this invention include support for 
15 different detection algorithms. When this invention is applied to a different algorithm, the 
system preferably collects run time data specific for the detection algorithm and develops 
algorithms for real time simulation using the data. The manner in which the graphical 
user interface presents the operating curves and the detection results can also be modified 
in various embodiments. 

20 [0047] The system has the following innovative features. Collection of run time frame 
data and detection information during an inspection scan. Real time simulation of defect 
detection upon entry of a new set of threshold parameters. Computing the operating 
curves of defect detection with respect to each individual threshold parameter in the 
recipe. Displaying multiple operating curves, one for each defect type, allowing the user 

25 to visualize the trade off between flagging real defects and flagging nuisances when 
tuning the threshold values. A graphical user interface that allows users to visualize and 
manipulate the threshold boundaries with respect to the defect populations by type. The 
ability to show flagged defects as well as unflagged defects in various forms, such as 
Pareto charts, substrate maps, or tabular summaries for a given threshold parameter set. 
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[0048] The foregoing description of preferred embodiments for this invention have been 
presented for purposes of illustration and description. They are not intended to be 
exhaustive or to limit the invention to the precise form disclosed. Obvious modifications 
or variations are possible in light of the above teachings. The embodiments are chosen 

5 and described in an effort to provide the best illustrations of the principles of the 
invention and its practical application, and to thereby enable one of ordinary skill in the 
art to utilize the invention in various embodiments and with various modifications as are 
suited to the particular use contemplated. All such modifications and variations are within 
the scope of the invention as determined by the appended claims when interpreted in 

10 accordance with the breadth to which they are fairly, legally, and equitably entitled. 
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